fflD-fll44  662  THE  GENERIC  LOCAL  TIME-OPTIMAL  STABILIZING  CONTROLS  IN  1/1 
[  DIMENSION  3<U)  WISCONSIN  UNIV-MADISON  MATHEMATICS 

RESEARCH  CENTER  A  BRESSAN  JUL  84  MRC-TSR-2718 
UNCLASSIFIED  DAAG29-80-C-0041  F/G  12/1  NL 


AD- A 144  662 


Mathematics  Research  Center 
University  of  Wisconsin— Madison 
610  Walnut  Street 
Madison,  Wisconsin  53705 


Approved  for  public  release 
Distribution  unlimited 


v  Sponsored  by 

U.  S.  Army  Research  Office 
P.  O.  Box  12211 
Research  Triangle  Park 
North  Carolina  27709 


84  08  24  03 7 


UNIVERSITY  OF  WISCONSIN  -  MADISON 
MATHEMATICS  RESEARCH  CENTER 


THE  GENERIC  LOCAL  TIME-OPTIMAL 
STABILIZING  CONTROLS  IN  DIMENSION  3 

Alberto  Bressan* 

Technical  Summary  Report  #2710 
July  1984 
ABSTRACT 

This  paper  studies  the  control  system 

x(t)  -  X(x(t) )  +  Y(x(t) )u(t) ,  X(p0)  -  0,  | u( t ) |  <  1  , 

where  X  and  Y  are  C  vector  fields  on  a  3-dimensional  manifold  M. 
Under  generic  assumptions  on  X,  Y,  the  structure  of  the  time-optimal 
stabilizing  controls  is  completely  determined  in  a  neighborhood  of  pQ.  The 
proofs  rely  on  a  systematic  use  of  a  local  asymptotic  approximation  of  X 
and  Y  by  means  of  vector  fields  which  generate  a  nilpotent  Lie  algebra. 
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SIGNIFICANCE  AND  EXPLANATION 


Let  f,  g  be  smooth  vector  fields  on  R^.  The  problem  of  local 
stabilization  for  the  control  system 

x(t)  -  f(x<t))  +  g(x<t ) )u(t)  (*> 

with  f ( 0 )  «  0  e  lPt  | u( t ) |  <  1,  is  the  following.  Given  a  state  x  in  a 
neighborhood  of  the  origin,  find  a  control  u(*)  that  steers  the  system 
from  x  to  the  origin.  If  the  transfer  is  accomplished  in  the  shortest 
possible  time,  u(*)  is  said  to  be  time  optimal.  In  this  paper,  the  time 
optimal  local  stablization  problem  is  solved  in  dimension  3,  under  generic 
conditions  on  the  nonlinear  vector  fields  f,  g.  Our  basic  technique  is  a 

rescaling  of  time  and  space  coordinates  which  transforms  (*)  into  the  system 

•  •  •  2 
(xirx2,x3)  -  (u,x1,x2  +  kx1/2)  +  h(x)  . 

When  h  2  0,  an  explicit  solution  is  found.  A  perturbation  analysis  then 

shows  that  the  local  structure  of  time  optimal  trajectories  is  retained  under 

the  addition  of  a  suitably  small  vector  field  h(*).  As  a  consequence,  the 

time  optimal  controls  can  be  written  in  regular  feedback  form. 
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The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC,  and  not  with  the  author  of  this  report. 


THE  GENERIC  LOCAL  TIME-OPTIMAL  STABILIZING  CONTROLS  IN  DIMENSION  3 


Alberto  Bressan 


1 .  Introduction 


Lat  M  be  a  3-dimensional  manifold,  pg  6  M  and  lat  X,  Y  ba  smooth  vector  fialda 
on  U  with  X ( pq )  -  0.  Consider  the  control  system 

y(t)  -  X(y(t ) )  +  Y(y(t))u(t) 

(1.1) 

y<<J)  ■  p0  . 

where  the  scalar  control  u(<)  is  measurable  and  satisfies  |u(t)|  <  1  almost  everywhere. 
This  paper  provides  a  description  of  all  admissible  controls  that  steer  the  system  (1.1)  in 
minimum  time  from  p0  to  any  point  p  in  a  neighborhood  of  pq.  Ms  show  that  the 
structure  of  the  local  time-optimal  trajectories  is  completely  determined  by  the  Lie 
brackets  up  to  order  three  of  X  and  Y  at  pg,  under  the  generic  assumptions 

( A1 )  The  vectors  Y,  [Y,X]  and  [[Y,X],X]  are  linearly  Independent  at  pg, 

(A2)  [Y,(Y,X]](p0)  -  C,  Y(p„)  +  R2(Y,X](p0)  +  itj  ttY.X)  ,X)  (p„ )  with  |  K3 1  1. 

For  the  system  (1.1),  a  numerical  algorithm  yielding  a  stabilizing  control  was  studied  in 
(7].  Sussmann  [12]  provided  a  complete  description  of  time-optimal  trajectories  for 

- - - -  '  7X,-3 

analytic  systems  in  the  plane.  The  present" work  is  part  of  a  general  program  of  research 

(cr  - - 

/  \ 

whose  goal  is  to  determine  the  local  properties  of  control  systems  of  the  form  (1.1)  from 
the  linear  relations  among  the  Lie  brackets  of  X  and  Y  at  p ^  Our  main  technique  is 
the  local  approximation  of  (1.1)  by  means  of  a  nilpotent  system  defined  on  the  same  state 
space  [1].  Somewhat  different  approximations  were  discussed  in  [3,  6)  and  applied  in 
[S,  11]  to  obtain  results  on  local  controllability.  From  (1.1),  a  suitable  rescaling  of 
time  and  space  coordinates  leads  us  to  the  system 
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<1.2) 


•  •  •  2 

(x^XjjXj)  -  (UfX^Xj  +  kx1/2)  +  h(x)  , 

(x^Xj.XjXO)  -  (0,0,0)  ,  t  e  [0,1]  , 

where  k  -  Ej,  end  the  vector  field  h(*)  is  as  small  as  we  please,  togehter  with  all  of 
its  high-order  partial  derivatives.  In  the  special  case  h  I  0,  the  trajectories  of  (1.2) 
are  easily  computed  as  integrals  of  the  control.  The  time-optimal  controllability  problem 
can  therefore  be  explicitly  solved  applying  Pontryagin's  Maximum  Principle.  Me  use  the 
directional  conVexity  of  the  reachable  set  and  a  global  necessary  condition  [2]  to  rule  out 
the  optimality  of  bang-bang  controls  with  more  than  two  switchings.  In  the  general  case, 
h  can  be  regarded  as  a  small  perturbation.  Repeated  applications  of  the  implicit  function 
theorem  complete  the  proof.  The  asymptotic  approximation  technique  used  here  appears  to  be 
quite  general  and  might  be  effective  in  the  study  of  higher  dimensional  systems  as  well. 


-2- 


2.  Main  Theorem 


As  a  preliminary,  notice  that  if  (A1)  holds,  by  the  implicit  function  theorem  the 
equation 

(Y,  [Y,X]] (y)  -  kt(y)Y(y)  +  k2(y> [Y,X] <y>  +  k3(y) [[Y,X] ,X) (y)  (2.1) 

uniquely  defines  the  smooth  functions  kj^y)  in  a  neighborhood  V  of  pg.  If  (A2)  holds 
with  |&3 |  >  1,  we  can  also  assume  | k3 ( y ) |  >  1  for  all  y  e  V.  Two  special  families  of 
trajectories  will  be  considered. 

Definition.  Let  y(*)  be  an  absolutely  continuous  map  from  (0,T]  into  M  with 
y(0)  “  pg.  He  say  that  y  is  a  BBB-trajectory  for  the  system  (1.1)  if  there  exist 
0  <  Ti  <  t2  <  T  such  that 

y  -  X(y)  +  Y(y)  or  y  -  X(y)  -  Y(y)  (2.2) 

on  each  one  of  the  (possibly  empty)  subintervals  (0,t^),  (t^.t 2),  (t2,T).  He  call  y(») 
a  BSB-trajectory  if  there  exist  0  <  <  Tj  <  T  such  that  (2.2)  holds  on  (0,Tj)  and  on 

(t2,E),  while 

y  -  X(y)  +  kj1(y)Y(y)  (2.3) 

on  (t^Tj). 

Our  main  result  states  that  the  bang-bang  and  the  partially  singular  trajectories  just 
defined  are  locally  the  only  optimal  ones. 

Theorem  1.  Consider  the  system  (1.1)  and  let  (Al),  (A2)  hold. 

1)  If  |E3 |  <  1,  then  there  exists  a  neighborhood  V  of  pQ  in  M  such  that  every 

time-optimal  trajectory  steering  pg  to  a  point  p  6  V  is  a  BBB-trajectory. 

ii)  If  |Jc3|  >  1,  then  there  exists  a  neighborhood  V  of  pg  such  that  every 

trajectory  steering  pg  to  a  point  p  e  V  in  minlRitmi  time  is  either  a  BBB-  or  a  BSB- 
trajectory. 

By  inverting  time  and  the  vector  fields  X,  Y,  Theorem  1  thus  yields  the  solution  of 

the  generic  local  time-optimal  stablization  problem  in  dimension  three,  k  noteworthy 

consequence  is  that,  at  least  for  analytic  X  and  Y,  this  solution  can  be  written  in 
regular  feedback  from  [13].  When  |Cj|  <  1,  (1.1)  behaves  essentially  like  a  linear 


ayst< 


am.  Part  i)  in  Theorem  1  could  alraady  ba  deduced  from  (10].  When  |1Ej|  >  1,  the 
nonlinearities  begin  to  play  a  major  role/  and  a  careful  analysis  is  required.  In  sections 
3,  4  we  prove  that  Theorem  1  is  a  consequence  of  an  analogous  result  ( Theorem  2)  concerning 
the  system  (1.2).  The  main  steps  in  the  proof  of  Theorem  2  are  collected  in  $S,  Technical 
details  are  then  worked  cut  in  ff6  to  10,  which  may  be  skipped  in  a  first  reading. 


i 


3.  An  Equivalent  Result . 

By  introducing  a  suitable  set  of  coordinates,  (1.1)  will  be  transformed  into  a  more 
tractable  system  on  R3.  In  tbs  following,  the  variable  in  A3  is  x  “  (x,  ,x2,Mj  )  and 
(•^,*^,*3)  denotes  the  canonical  orthonormal  basis.  Given  a  smooth  vector  field  g  - 
(gi,g2,g3)  on  R3,  its  partial  derivatives  are  written 

*2«1 

gi,j  "  '  gi,jk  “ 

Vg  denotes  the  3x3  matrix  of  first  order  partials  of  g.  Consider  the  map 

9  t  (s1,a2,s3>  ♦  (exp  s^)  •  (exp  s2(Y,X])*  (exp  Sj[  [Y,X]  ,X) ) (pQ)  ,  (3.1) 

where  (exp  sz)(p)  is  the  velue  at  time  s  of  the  solution  of  the  Cauchy  problem 

y(t)  -  z(y(t>)  ,  y(0)  -  p  eH  . 

Because  of  (A1),  9  defines  a  local  chart  of  a  neighborhood  of  p0.  in  this  chart. 


the  system  (1.1)  becasns 


x  -  f(x)  +  e,u  ,  x(0)  -  0  e  R3  . 


The  vector  field  f  can  be  written  in  the  form 

f(x)  ■  (ktx2/2  ,  x1  +  k2x2/2  ,  Xj  +  k3x^/2)  +  f(x)  (3.3) 

with  ^ (0 )  -  tl  3 ^  (0 )  -  0  for  i  -  1,2,3,  j  -  1,2. 

8ince  the  problem  la  local,  we  can  assume  that  9  is  defined  on  some  open  ball 
e  r3  centered  at  the  origin  with  radius  r,  and  that  f  can  be  extended  outside  Br 
to  e  C  "ector  field,  etlll  called  f,  with  compact  support,  we  now  apply  to  (3.2)  the 
asymptotic  rescaling  procedure  dlecusaed  in  [1].  Consider  the  orthogonal  decomposition 
R3  *  W1  •  w2  •  W3  with  Wj  ■  (Ce^igeR}.  Let  t  R3  ♦  be  the  canonical  projections. 
Given  an  admissible  control  u(*)«  let  t  ♦  x(u,t)  be  the  corresponding  trajectory  of 
(3.2).  If  u  is  defined  on  the  time-interval  [0,e],  construct  the  rescaled  control 
ue  «  (0,1)  ♦  R  by  setting  ue<t)  ■  u(et).  Moreover,  set 

x*(u  ,t)  *  I  3  t”1  *,(x(u,tt))  .  (3.4) 

i-1 

A  direct  computation  shows  that  x*  is  the  response  of  the  system 


x(t)  ■  f*(x(t))  ♦  e^ft)  ,  x(0)  -  0  e  B3 


with  f*  -  (f*,f*,f3), 


I 


(3.6) 


ff(x)  -  e1-1f  (  l  3  eVfx))  . 

j-1  3 


For  every  e  >  0,  (3.5)  is  merely  a  linear  rescaling  of  (3.2).  Therefore,  a 

control  u  is  time-optimal  for  (3.2)  on  [0,e]  if  and  only  if  the  corresponding  u£  is 
time-optimal  for  (3.5)  on  (0,1).  Because  of  (3.3),  the  main  result  proved  in  [1]  now 
Implies  that,  as  t  *  0,  fe  converges  to  the  vector  field 

?(x)  -  (0,x,,x2  +  Ic3x^/2)  (3.7) 

together  with  all  partial  derivatives,  uniformly  on  bounded  sets.  Theorem  t  thus  becomes  a 
consequence  of  the  following  result  concerning  the  system  (1.2).  If  k  >  0,  we  write  0^ 
for  the  open  box  (-2,2)  x  (-1,1)  x  (-1-k,  1+k)  <=  jj3f  C3(fl^)  for  the  Banach  space  of  three 
times  continuously  differentiable  vector  fields  on  0^,  and  we  let  F  be  the  family  of 
all  neighborhoods  of  the  null  vector  field  in  C3(S)^). 


Theorem  2. 

a)  If  0  <  k  <  1,  then  there  exists  1/  6  F  such  that  for  all  h  e  V ,  0  <  T  <  1,  every 
time-optimal  control  u( • )  for  (1.2)  on  [0,T]  is  hang-bang  with  at  most  two 
switchings. 

b)  If  k  >  1,  then  there  exists  V  e  F  such  that,  given  any  h  e  {/ ,  every  time-optimal 

control  u  for  (1.2)  on  (0,T)  (0,11  has  the  following  property.  Either  u  is 

bang-bang  with  finitely  many  switchings  on  [0,T],  or  there  exist  0  <  t^  <  tj  <  T 
such  that  u(t)  is  constantly  equal  to  +1  or  -1  on  [0,^1  and  on  [t2»T]  , 
while  u(t)  -  kj'lxtt))  on  (tj,t2).  Here  kj(x)  is  the  third  coefficient  in  the 
linear  relation 

l«1,  tm^g]  l(x)  »  k1(x)«1  +  kj(x)  [m^gj  (x)  +  kj(x)  [  [e,  ,gj  ,g)  (x)  ,  (3.8) 

with  g  “  J  +  h. 

c)  If  k  >  1,  then  there  exists  V  8  F  such  that,  if  h  e  \J  and  u  is  a  bang-bang 

control  with  initial  switchings  at  times  0  <  (  tj  <  tj  •  1,  then  u  is  not  time- 

optimal  for  (1.2)  after  time  1. 

As  usual,  statements  concerning  controls  in  L1  are  always  meant  "up  to  in¬ 
equivalence"  . 
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4.  Proof  of  Theorem  1 


Lot  Theorem  2  hold.  By  poeelbly  replacing  y  with  -Y  in  (»2)  we  can  aaauma 

k3  >  0.  Consider  the  caae  0  <  kj  <  1  first.  Sat  Ic  “  Jc3  and  choose  the  neighborhood 

V  e  F  according  to  a)  in  Theorem  2.  Choose  e  >  0  so  small  that  the  reachable  set  at 

time  e  for  the  system  (1.1)  is  contained  within  the  range  of  the  chart  0,  i.e. 

€  — 

R(e )  c  0(Br),  and  each  that  c  Br,  h  •  f  -  f  e  V.  This  is  possible  becauee,  as 

e  +  0,  the  convergence  of  fc  to  f  in  (3.6),  (3.7)  is  uniform  on  the  bounded  set  0^ 
[1].  If  the  control  u  eteers  the  syetam  (1.1)  from  p0  to  some  point  p  e  R(e)  in 

minimum  time  n  <  e,  then  the  control  t  ♦  u£ ( t )  «  u(et)  is  time  optimal  for  the  system 

(1.2)  on  the  interval  (0,ne-1]  c  (0,1].  By  a)  in  nieoram  2,  u£  is  bang-bang  with  at 

most  two  switchings,  hence  the  same  holds  for  u.  Talcing  V  -  R(e),  this  proves  i)  in 

Theorem  1.  The  proof  of  ii)  is  similar.  If  lc3  >  1,  set  Ic  -  S3  and  choose  V  e  F 
according  to  b)  and  c)  in  Theorem  2.  Choose  t  >  0  such  that  R(c)  c  8(Br>,  c  B^ , 
f*1  -  f  «  V  for  every  n  «  [0,e].  If  0  <  n  <  e  and  the  control  u  is  time-optimal  for 
(1.1)  on  [0,h] ,  then,  setting  h  ■  tC  -  f,  the  control  t  ♦  ue(t)  “  u(et)  is  optimal 
for  (1.2)  on  I0,ne-1]  c  [0,1].  By  b)  in  Theorem  2,  either  u6  is  partly  singular,  or 
ue  is  bang-bang  with  finitely  many  switchings,  hence  the  same  holds  for  u.  In  the  first 
case,  comparing  (3.8)  with  (2.1)  one  concludes  that  u  generates  a  BSB-trajectory,  because 
the  linear  relatione  among  the  Lie  brackets  of  the  vector  fields  f,  e1  are  preserved 
under  the  transformation  (3.6).  In  the  second  case,  if  u  has  more  than  two  switchings 
inside  [0,n] ,  let  0  <  tt  <  t2  <  t3  -  n'  <  n  be  its  first  three  switching  times.  The 

n  1  — - 

control  t  ♦  ^.(t)  -  u(h't)  has  then  its  third  switch  at  t  “  1.  Since  f  -  f  e  1/, 

using  c)  we  see  that  u^,  is  not  optimal  after  time  1,  hence  u  is  not  optimal  at  time 

n  >  n',  a  contradiction.  Taking  V  ■  R(e),  this  completes  the  proof  of  part  ii). 


3 

0 
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5.  Sketch  of  the  Proof  of  Theorem  2. 

In  the  following,  we  denote  ?(x)  the  vector  field  with  components  (0,x1,x2  +  kx^/2 ) j 
h  ie  the  email  perturbation  and  g  »  f  +  h.  He  write  B£  for  the  open  ball  centered  at 
the  origin  with  radius  e.  When  h  =  0,  the  exact  solution  of  (1.2)  is 


Xj(u,t)  -  u(s)ds 

Xj(u,t)  »  J*  (t-s)u(s)ds  (5.1) 

x3(u,t)  -  -j  /q( t— s ) 2u( s )ds  +  |  /*(/£  u(r)dr)2ds  . 


If  u  is  an  admissible  control,  i.e.  if  |u(t)|  <  1  almost  everywhere,  then  for 

t  6  [0,1]  the  trajectory  t  ♦  x(u,t)  is  contained  inside  the  closed  box 
1  1  v+1  v+i 

[-1,1]  x  [-—,—]  x  [-  — —  ,  — — ]  .  By  a  classical  perturbation  theorem  [5],  there  exists 
a  bounded  neighborhood  ^  e  f  such  that,  if  h  e  Vg,  every  admissible  trajectory  for 
(1.2)  remains  inside  during  the  time  interval  [0,1].  The  neighborhood  now 

chosen  will  be  kept  fixed  throughout.  The  first  part  of  our  proof  will  single  out  all 
solutions  of  the  Pontryagln's  equations  for  (1.2)  on  any  Interval  [0,T]  [0,1]. 

(Xj.Xj.Xj)  -  (u  ♦  hj(x) ,  Xj  +  hj(x) ,  x2  +|x|  +  h3(x))  , 


( WV  “  _<X2  +  kxlX3  +  ri-1  hi,1Xi  ' 

X3  +  Ei-1  hi,2Xi  '  Zl-1  hi,3Xi)  ' 

(x,,x2,x3)(0)  -  (0,0,0),  (A1,12,X3)(T)  -  (I^Ij.Ij)  , 

u(t)  e  sgn  X^t)  a.e.  on  [0,T]  , 

where  X  »  (X,,X2,X3)  f  (0,0,0),  0  <  T  <  1  and  the  convention  sgn  0  -  [-1,1] 
Notice  that  for  every  data  X  and  T,  (5.2)1_4  has  at  least  one  solution, 
compactness  of  the  reachable  set  R(T)  implies  the  existence  of  a  control  u 
x(u,T)  -  max{<T,x>»  x  e  R(T)}.  Such  u  clearly  yields  a  solution  of  (5.2). 


(5.2) , 

(5.2>2 

(5. 2) 3 

( 5 . 2 )  4 

Is  used. 
Indeed,  the 
for  which 
Different 


types  of  extremal  controls  arise,  depending  on  the  direction  of  X 


Proposition  1.  Thsrs  sxists  ^  «  F  such  that,  if  h  e  Vy  and 
—  2  -2  —  2—2 

Xj  <  (12k  +  16)  (X^  +  X2  ),  then  the  solution  (u,x,X)  of  (5.2)  is  unique  and  the 
corresponding  control  u  is  bang-bang  with  at  most  one  switching. 

Proposition  2.  For  every  e  >  0  there  exists  l/;  e  F  such  that,  if  h  6  Vj  and 
Xj2  >  (12k  +  16)  2(X^2  +  Xj2),  then  any  solution  (u,x,X)  of  (5.2)  satisfies 

X^t)  e  ((1  -  k  agn  X^t))  +  B£]I3  (5.3) 

a.e.  on  [0,T] . 

The  two  above  results  together  imply  part  a)  of  Theorem  2.  Indeed,  let  0  <  k  <  1 

and  choose  the  neighborhoods  l !y,  V2  according  to  Proposition  1  and  2  with  e  -  (1-k)/2. 

If  h  e  V]  n  and  if  (u,x,X)  is  a  solution  of  (5.2),  then  either 
—  2  -2  —  2—2 

X3  <  (12k  +  16)  (Xj  +  X2  )  and  by  Proposition  1  u  is  bang-bang  with  at  most  one 
switching,  or  Xj2  >  (12k  +  16)  ^X.^2  +  ^22)*  In  thiB  ca8®»  by  (5.3)  and  the  choice  of 

e,  Xj(t)  has  a.e.  the  same  sign  of  X3<T)  ■  X3  ^  0.  Hence  X1  is  either  strictly  concave 

or  strictly  convex  on  [0,T]  and  can  vanish  at  most  at  two  distinct  points.  The 
corresponding  control  u  is  therefore  bang-bang  with  no  more  than  two  switchings.  Next, 
we  assume  k  >  1  and  study  the  case  where  the  third  component  of  X  is  large  compared 
with  the  others. 

Proposition  3.  If  k  >  1,  there  exists  V2  e  F  such  that  every  solution  (u,x,X)  of 

— 2  -2—2—2— 

(5.2)  with  h  e  l/3,  X3  >  (12k  +  16)  (X^  +  X2  ),  X3  <  0,  has  the  following  property. 
There  exist  0  <  t1  4  t2  <  T  such  that  u  is  constantly  equal  to  +1  or  -1  on  [0,t^] 
and  on  (Tj,T]  ,  while  u(t)  “  k^txtt))  on  (T  3  #T2 )  ♦  Here  k3(x)  is  the  scalar  function 
defined  at  (3.8). 

Proposition  4.  If  k  >  1,  there  exists  V4  e  F  such  that,  for  every  solution  (u,x,X) 

—  2  —2  _  2  _  2  _ 

of  (5.2)  with  h  e  X3  >  (12k  +  16)  (X1  +  X2  )  and  X3  >  0,  either  the  control  u 

is  bang-banq  with  finitely  many  switchings  on  [0,T],  or  u(t)  ”  k^fxft))  throughout 
[O.TJ. 
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Propositions  1,3  and  4  clearly  imply  part  b)  of  Theorem  2.  To  prove  c),  define  the 
set  of  vectors 

A  »  {w  -  (w1,w2»w3)  e  R3)  w 2  >  (12k  +  16) 2 (w2  +  w2)} 

Choose  l/1  e  F  according  to  Proposition  1.  An  application  of  Theorem  2  in  (2)  yields 

Corollary  1.  If  he  Vf,  then  the  reachable  set  R(1)  for  the  system  (1.2)  is 
A  -  convex,  i.e.  R( 1 )  contains  the  point  £p  +  ( 1-5 )q  whenever  p,  q  e  R( 1 ) ,  5  e  (0,1) 
and  p-q  e  A. 

Let  now  u  be  a  bang-bang  control  satisfying  Pontryagin'a  conditions  and  having  a 
third  switch  at  time  t  »  1.  To  prove  that  the  value  x(u,1)  of  the  corresponding 
trajectory  at  time  1  lies  in  the  interior  of  R(1),  it  suffices  to  exhibit  a  second 
admissible  control-  say  u' ,  such  that 

xi(u',1)  ■  x1(u,1)  for  i  *  1,2  ,  X3(u',1)  >  x3(u,1)  •  (5.4) 

Indeed,  if  (u,x,X)  is  a  solution  of  (5.2),  then  X3 ( 1 )  >  0  because  of  Propositions  1  to 
3.  The  vector  w  «  x(u',1)  -  x(u,1)  -  (0,0,x3(u* , 1 )  -  x3(u,1)>  therefore  has  a  positive 
inner  product  with  A(1)  and  lies  in  the  interior  of  A.  By  Theorem  1  in  (2), 
x ( u , 1 )  e  int  R( 1 ) .  To  complete  the  proof,  we  only  need  to  show  that  such  a  control  u’ 
always  exists.  For  a,  b,  c  >  0  define  the  control  u+  "  u+(a,b,c)  by  setting 
u+(a,b,c)(t)  »  1  for  t  e  (0,a)  u  [a+b,  a+b+c)  , 

(5.5) 

u  (a,b,c)(t)  «  -1  for  t  @  [a,  a+b)  u  (a+b+c,  “)  . 

If  a,B,Y  >  0,  define  u-(a,8,Y) (t)  «  -u+(a,8,Y ) (t) .  Call  x+  »  x+(a,b,c)  the  point 
reached  by  the  system  (1.2)  at  time  T  “  a+b+c,  subject  to  the  control  u+(a,b,c)  and 
define  x"  =  x”(a,B,T)  similarly.  In  the  special  case  h  =  0,  the  components  of  x+,  x” 
can  be  explicitly  computed  from  (5.1): 
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a-b+c 


x*  “  a-b+c  ,  Xj  ”  ( a+b+c )2/2  -  (b+c)  +  c2  , 

Xj  -  j  {j  (a+b+c)3  -  (b+c)3  +  c3  +  k[a3  +  (b-a)3  +  -j  (c-b+a)3)}  , 


(5.6) 


-a+B-Y 


x"  -  -(a+$+Y)2/2  +  (8+r)2  -  Y2 


xj  -  -j  {-  -j  ( a+6+Y ) 3  +  (6+Y)3  -  Y3  +  k[a3  +  (B-a)3  +  j  (Y-B+a)3]} 
The  three  conditiona 

/  a+b+c  -  a+B+Y  “  T 


+ 

X  m  X 

XI  X1 


*2  ”  X2 


imply  the  relations 


a  »  bc/(a+c)  ,  B  «  a+e  ,  Y  “  ab/(a+c)  , 

a  -  6Y/(a+Y)  .  b  -  a+Y  ,  c  -  a8/(a+r)  • 


(5.7) 

(5.8) 

(5.9) 


When  these  are  satisfied,  we  have  Ax  «  x+(a,b,c)  -  x”(a,B»Y)  “  (0,0, x*  -  x”)  and  a  direct 
calculation  (see  Appendix)  shows  that 


x^  -  x“  »  [(a+b+c)  -  k ( a-b+c )Jabc/(a+c) 


(5.10) 


-  [(a+B+Y)  +  k(a-8+Y)]aBY/(a+Y)  • 

If  a,b,c  >  0  and  u+(a, b,c)  satisfies  the  Maximum  Principle  on  [0,  T+t ]  for  some 
c  >  0,  then  the  corresponding  adjoint  variable  X  in  (5.2)  satisfies 


x3(t) 

-  X3  >  0 

V 

t  8  [0,T]  , 

Xt(a) 

-  X^a+b) 

“X1 

(a+b+c)  -  0  , 

X,(t) 

-  (1+k  )Tj 

for 

t  e  (a,  a+b)  , 

X,(t) 

-  (1-k)I3 

for 

t  8  (a+b,  a+b+c)  . 

The  above  relations  imply  (k+1)b  -  (k-1)c.  Using  this  equality  in  (5.10)  we  obtain 

2 


x*  -  x”  ■  ( 1-k)a‘bc/(a+c)  <  0 


(5.11) 

J  J 

If  u  ■  u+(a,b,c),  consider  the  control  u*  -  u”(a,B,Y)  with  a,  B,  Y  defined  at 
(5.8).  When  T  -  a+b+c  ■  1,  (5.7)  and  (5.11)  imply  (5.4).  Therefore  u  cannot  be  optimal 

after  time  T  -  1 .  The  case  where  the  bang-bang  control  u  takes  initially  the  value 
-1  can  be  treated  similarly.  Let  u  ■  u  (a,B,Y)  for  seme  a,  6,  Y  >  0.  if  Pontryagin's 
equations  (5.2)  are  satisfied,  then  (k-1)B  “  (k+1)Y.  Consider  the  control  u'  ”  u+(a,b,c) 


with  a,  b,  c  defined  in  tenia  of  a,  6,  Y  at  (5.9).  Proei  (5.10)  and  the  above  equality 
we  now  obtain 

x3  -  x"  -  Ot+1)o28Y/(a+Y)  >  0  .  (5.12) 

When  T  -  a+B+Y  “  1«  (5.7)  and  (5.12)  imply  (5.4).  Therefore  u  *  u”  cannot  be  optimal 

after  time  T  -  1.  This  eatablishea  part  c)  of  Theorem  2  in  the  oaae  h  =  0.  Thanks  to 
the  implicit  function  theorem,  the  above  arguments  remain  valid  when  a  small  perturbation 
h  is  added  to  the  vector  field  F  in  (1.2). 

Proposition  5.  There  exists  Kj  e  F  such  that,  if  h  B  Vj  and  if  u  is  a  bang-bang 
control  with  initial  switchings  at  times  t^  t  0  <  tj  <  tj  <  t3  •  1  which  satisfies 
Pontryagin's  equations  (5.2)  on  10,1]  with  X^l)  »  0,  then  there  exlste  a  second 
admissible  control  u1  such  that  (5.4)  holds. 

This  will  complete  the  proof  of  Theorem  2. 
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6.  Proof  of  Proposition  1 


H 


Lama  1.  Let  k  >  0,  X  e  *3  with  I X |  -  (X3  +  X*  ♦  x\^2  "  1*  Set  n  .  (12k+16)-1  and 
2  2  2  2 

a  a  sum*  X^  <  ri  ( X  ^  ♦  X^).  Than  at  laast  ona  of  tha  following  holds 
i)  Ixj  >  |X2|  +  (2k+1 )  | X j |  +  (2k+4)n 
ii)  |Aa|  >  (2k+1)|X3|  +  (2k+4)n. 

Indeed,  if  li)  fails,  since  I X} |  <  n  we  have 

| X, |  >  1  -  |X2|  -  |X3|  >  1  -  t(2k+1 ) | X 3 1  +  (2k+4)n)  -  n 

>  (8k+10)n  >  |X2|  +  (2k+1 ) |Xj )  +  (2k+4)n  . 

Lemma  2.  There  exists  a  constant  H  >  0  such  that  every  solution  (u,x,X)  of  (5.2) 
with  | X |  -  1,  h  e  Kg,  satisfies 

M-1  <  |X(t)|  <  M  V  t  e  (0 ,T)  ,  (6.1) 

|x1(t)|<M  ,  |X1(t)|<M  ,  i  -  1,2,3  ,  t  6  [0,T]  .  (6.2) 

Proof.  Since  Kg  is  bounded  in  C3(flk),  the  operator  norma  of  the  matrices  Vg(x)  of 
first  order  partial  derivativea  of  g  ■  J+h  satisfy  a  uniform  bound,  say  |Vg(x)|  <  N, 
for  all  he  K0,  x  e  nfc. 

By  (5.2)2,  (6.1)  holds  with  M  -  eN.  The  bounds  in  (6.2)  follows  from  (5.2) ,_2  and 
(6.1),  with  a  possibly  larger  constant  M. 

To  prove  Proposition  1,  it  clearly  suffices  to  consider  the  case  |x|  -  1.  Set  n  ■ 
(12k+16)-1  and  define  H '  "  *1/3M,  with  M  being  the  constant  in  (6.1),  (6.2).  Choose  a 
neighborhood  Vy  Kg  in  F  such  that  Ih^jtx)!  <  n'  for  all  x  e  1)^,  h  6  I/1 , 
i , j  e  {1,2,3}.  By  Lemma  1,  two  cases  must  be  considered. 


Case  1.  Let  |Xj  >  |X2|  +  (2k+1)|X3|  +  (2k+4)n.  Then  for  t  e  [0,T]  [0,1], 

(5.2)2  we  obtain 

|X3(t)|  <  3n'M  -  n  , 

|x3(t)  |  <  |x3|  +  n  , 

|X2(t)|  <  |I3|  +  h  +  3n'M  , 

|X2(t)|  <  |I2|  +  |X3|  +  2n  , 


using 


(6.3) 

(6.4) 
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JL _ 


JL  ... 


Therefore  X^t)  ?  0  throughout  the  interval  [0,T].  Brom  (5.2)4  we  deduce  u(t)  “ 
agn  X  t  { t )  -  agn  T 1 .  The  control  u  la  thua  uniquely  determined  end  conatant  throughout 
[0,T]. 

Caae  2.  Let  |72|  >  (2k+1)|X3|  ♦  (2k+4)n.  From  (5. 2>1_2,  uaing  (6.3)  and  (6.4)  vie  now 
obtain 

|x2(t)|  >  |X2|  -  |I3|  -  2n  , 

(6.5) 

|x1(t) |  >  (|x2|  -  |x3|  -  2n)  -  2k< |X3|  +  n)  -  3n’M  >  h  >  o  . 

By  (6.5),  X^*)  la  a  atrictly  monotone  function,  with  at  moat  one  aero.  By  (5.2)4,  the 

correaponding  control  u(*>  la  bang-bang  with  at  moat  one  awltching  inside  (0,T).  We 
claim  that  auch  a  control  u  la  unique,  whenever  h  8  for  a  suitably  small  neigh¬ 

borhood  ^  e  F.  To  set  the  ideas,  assume  X2  >  0,  the  caae  X2  <  0  being  entirely 
analogous.  Define  the  set 

r  -  {xen3,  1  x I  -  i,  x3  <  n2(X3+X2),  X2  >  (2k+i)|x3|  +  (2k+4)n) 
and  fix  X  e  r,  0  <  T  <  1.  Bor  re  [0,T]  define  the  control  u(T,»)  by  setting 
u(T,t)  -  1  when  t  e  [0,r],  u(T,t)  -  -t  when  t  e  (T,TJ,  and  let  x(r,*),  X(t,«)  be  the 
solutions  of  (5.2)1_3  correaponding  to  the  control  u(T,*>.  Since  X  e  T,  we  already  know 
that  any  solution  of  ( 5.2 ) ,_4  is  of  the  form  (u(T,»),  x(T,»),  X (T , • >  >  for  aome  T  e  [0,T] . 
Notice  that  (5.2)4  holds  iff  either  t  -  0  and  1^0,0)  <  0,  or  0  <  t  <  T  and 

X ^ (T  ,T )  -  0,  or  T  -  T  and  X^T.T)  >  0.  Uniqueness  will  be  established  by  proving  that 


2_Xi(t.t)  <  o 


v  r  e  [o  ,t] 

When  h  5  0  in  (1.2),  a  direct  calculation  yields 

x  (T,s)  ■  2t-b  V  a  e  [t ,T)  , 

X,  ,  X,(T,a)  -  X,  +  (T-s)X 

n 


(6.6) 


Xj ( T ,s)  -  ^  2  *  ‘  t a '  ~  '  '*  -'"3 

X ^  ( T  , t )  -  X,  +  [Tj  +  (T-S)T3  +  k(2T-S)r3]dS 

^  X^T.T)  -  -T2  -  (T-T)X3  -  ktTj  +  2k!T-T)X3 

<  -Ij  +  (1+2k)|x’3|  +  kn  <  -(k+3)n  <  o  . 


(6.7) 
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.... 

% 

• 

y. 

|X 3 ( t )  |  <  |X2|  +  |X3|  +  2n  +  2k( |Xj|  +  n)  ♦  3n’M  , 

M 

1  x, ( t >  |  >  jxj  -  ( |Ta I  +  |x3|  +  2h)  -  2k(  lljl  +  n)  -  n  >  n  >  o  . 

.  - i 

S-,  1 


t. 


This  provss  (6.6)  when  h  =  0.  To  cover  ths  general  csss,  notles  that  (6.7)  holds 
uniformly  as  (T,T,X)  range  in  ths  compact  sat  (T,Te*»  0<x<T<l}*r.  Moreover,  by 
tha  implicit  function  thaoram,  ths  total  darivativa  of  X1 (t  ,t )  w.r.t.  t  dapands 
continuously  on  t,  T,  X  and  on  the  partial  darivativas  of  ordar  <  2  of  ths  vector 
field  h.  Therefore,  if  tha  neighborhood  e  F  is  suitably  small,  (6.6)  still  holds  for 
any  h  e  nils  completes  the  uniguaness  proof. 
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* 

7.  Proof  of  Proposition  2. 

Again  it  is  not  rastrictivs  to  assune  |X|  »  1.  In  this  csss  the  asawptions  iatply 
| A 3 1  >  (24k+32)-2.  Let  M  be  the  constant  in  (6.1),  (6.2)  and  choose  torn  a  >  0  for  • 

which 

(24k+32)2(9+9M+10k)H9  <  e  .  (7.1) 

Choose  e  F  contained  in  Vq  such  that 

|h1#j(x)|  <  a  ,  |h1#jt(x)|  <  a  ,  |h1(x) |  <  a  (7.2)  * 

for  all  h  e  V2,  x  e  fl^,  l,j,t  e  {1,2,3}.  Since  the  right-hand  side  of  (4.3>2  i»  abolutely 
continuous,  we  can  differentiate  (4.3)2  once  more: 

*1  "  “^2  ”  k*1*3  “  kx^3  "  Sj»!  hi  ij(x)xj^i  “  Ei»i  hi  •  (7.3) 

Using  the  bounds  (6.1),  (6.2),  (7.1),  (7.2)  and  the  relations 

-  J2  -  «  *3  +  hA  2(x)Xi  -  kuij  -  khj(x)X3  ,  (7.4) 

|J3I  -  I**.,  h±  3X1 1  <  30H  ,  |X3(t)  -  T|  <  3 <JM  ,  IxJ  <2 

we  obtain 

|X1(t)  -  (1  -  ku(t))X3|  <  <9+10k+9M)MO  <  e(24k+32)  <  e|X3|  . 

- 

9 


t 


» 


I 
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8.  Proof  of  Proposition  3. 

Sat  e  -  (k-1)/2  and  choosa  V  8  F  according  to  Proposition  2.  Choose  V"  e  F  so 
small  that,  whenever  h  6  V"  and  g  8  ?+h,  the  following  conditlona  hold  at  every  point 

x  e  nk. 

i)  The  vectors  [e.,,g](x)  and  ( te1 ,g]  ,gj  (x)  are  linearly  Independent, 

il)  in  (3.8),  k3(x)  >  1. 

Such  a  V"  exists.  Indeed,  when  h  5  0  we  have  g  =  f  and  (ei,f)(x)  -  (0,1, kx 1 ) , 
([•),?] ,fl (x)  “  (0,0,1),  [e1,ls1,!]](r)  ■  (0,0, k).  In  this  case  the  coefficients  of  the 
linear  combination  (3.8)  are  kf(x)  “  k2(x)  "  0,  k3(x)  •  k>1.  By  continuity,  the 
conditions  1)  and  il)  remain  valid  whan  h  ranges  within  a  suitably  small  neighborhood  of 
the  null  vector  field  in  C3(flk>.  Mow  set  Vj  »  V'  n  V"  and  let  (u,x,X)  be  a  solution 
of  (S.2)  with  T32  >  ( 12k+16)”2(T^2  +  Tj2),  X3  <  0.  We  claim  that  S  - 
(t  e  [0 ,T]  i  A.|(t)  >0}  is  a  closed  interval,  posalbly  empty.  If  t^,  t2  6  S,  let 
|  X 1  (r )  |  -  max{|X^(t)|*  t1  <  t  <  tj}.  Tf  Ajti)  j  0,  then  u(t)  -  sgn  X^t)  is  constant 
on  a  neighborhood  of  T,  hence  X^  is  twice  differentiable  at  t.  Since  Xj  <  0,  (5.3) 
and  the  choice  of  e  imply  that  sgn  X 1  { T )  «  sgn  A^t),  a  contradiction  that  proves  our 
claim.  If  S  is  empty.  Proposition  3  trivially  holds  tv  setting  t1  -  t2  «  0.  If  S 
contains  a  single  point  T,  set  T1  »  Tj  -  T.  Finally,  let  S  be  a  nondegenerate 
interval,  say  We  need  to  show  that  u(t)  -  k^txtt))  a.e.  on  S.  The  relations 

X ^(t)  -  Xt(t)  *  X 1  (t )  *  0  imply 
<X(t),  et>  -  0  , 

<-X(t),  e^  -  <X(t) ,  Vgtxlt))*^  -  <X(t),  [•,  ,gj  (x(  t )  )>  -  0  , 

<X1(t),  «,>  *  “  <Mt),  Ie1,g)(x(t)» 

“  <X(t),  Vg(x(t))  Ce3  g]  ( x  ( t )  )  -  7  (•1  ,g]  (x(  t )  >  (g(x(t>)  +u(t)e1)> 

“  <X(t),  [ [e1 ,g] ,gj (x(t ) )  -  u(t) Ce1 [m^.gj J (x(t) )>  -  0  . 

Since  X ( t )  never  vanishes,  for  t  e  (T^ij)  the  vectors  [e1,g](x(t))  and 

Ue^,g]  ,g]  (x(t) )  -  u(t)[e1r  [e1  ,g]  ]  (x(t) ) ,  being  orthogonal  to  X(t),  are  linearly 
dependent.  Because  of  the  assumption  i),  u(t)  is  uniquely  determined  and  thus  coincides 
with  k^lxlt)),  defined  by  (3.8). 


9.  Proof  of  Proposition  4. 

Sons  preliminary  technical  results  are  needed. 

Lemma  4.  Let  t  >  0  and  let  4  be  a  twice  differentiable  concave  scalar  function,  with 
4(0)  *  4(t)  »  0,  4(0)  >  0,  and  let  a,  m1(  m2  be  positive  constants  such  that 

-*2  <  4<t)  <  -«1  <  0,  |4(t)  -  4(f)|  <  o|t-t'|  (9.1) 

for  all  t,  t'  e  (0,t],  Iben 

l4(t)|  >  4(0)  -  4«(m1  +  2m2)m^3  ♦2(0)  .  (9.2) 

Proof.  The  first  assumption  in  (9.1)  implies  T  6  [2((0)/m2>  24(0)/:^]  .  Let  a  - 
-4(0)  >  0  and  define  the  energy  E(t)  “  $Z(t)/2  +  a4(t).  Then 
l^—^l  -  |4(t)(4(t)  +  a)  |  <  4(0)(l  +  ^)*t. 

Integrating  from  0  to  x  we  obtain 

|*(t)  -  1(0) |  <  2s(m1  +  2m2)m"3  $3(0)  .  (9.3) 

This  implies  (9.2)  because 

|4(t)|  -  |4(0)|  -  (42(t)  -  42(0>){|4(t)|  +  |4(0)  |  )-1 

<  |e«t)  -  b( o ) j  |$(0)|_1  . 

Lemma  5.  Let  (d„)n>1  be  a  sequence  of  strictly  positive  numbers  such  that  dJ)+1  >  d^-c^ 

for  soma  constant  C  >  1  and  all  n  *  1  •  Then  S*_1  d^  •  +«•. 

Proof.  If  the  series  converges,  then  d„  ♦  0,  hence  dn  <  1/2C  for  all  n  >  N,  with  H 

suitably  large.  We  claim  that  d„+n  >  n-1dN+1  for  all  n  >  1.  Indeed,  if  this  Inequality 

holds  for  some  n,  then 

Wi  *  "ln{x "  0,2 '  <W"  *  x  <  1/2C)  “ 

"  n  dN+1  2  dU*1  *  ^n  2  '  Ic^S+l  *  dN+1/<n+1)  * 
n  n 

By  induction,  our  claim  holds  for  every  n  >  1,  showing  that  the  series  diverges,  a 
contradiction. 

Lemma  6.  Let  h  ®  Kq  and  let  t  ♦  (x(t),A(t))  be  any  local  solution  of  the  autonomous 
differential  equation  on  if: 


x(  t )  -  9(  x(  t ) )  +  s,  Jt(t  >  -  -X(t)*7g(x(t)) 
obtained  by  setting  u(t)  3  1  in  (5.2)1.2.  There  exlete  a  conetant  o’  euch  that 

|(d3/<lt3)X1(t)|  <  o'  | X C t )  | ,  |(d/dt)X3(t)|  <  <r’  (X  (t )  |  (9.4) 

whenever  x(t)  0  The  smallest  possible  constant  o'  in  (9.4)  approaches  zero  as  the 

vector  field  h  ”  g-F  tends  to  zero  in  C3(^k).  The  same  holds  for  the  system 
x(t)  ■  g(x(t) )  -  J(t)  »  -X(t)*7g(x(t) )  . 

All  of  the  above  is  clear  because  the  left  hand  sides  in  (9.4)  depend  continuously  on 
x,  X  and  on  the  vector  field  h  e  C3(flk>,  and  vanish  identically  when  h  3  0. 

Proposition  4  can  now  be  proved,  fix  e  ■  (k-1)/2,  choose  V2,^3  ®  ^  according  to 
Proposition  2  and  3  and  set  ^4  “  ^2  n  ^3*  L*t  h  e  ^  and  let  (u,x,X)  be  a  solution  of 

(5.2)  with  | X |  -  1,  X  satisfying  the  assuzgstions  made  in  Proposition  4.  If  X^tt)  -  0 

for  all  t  e  [0,T],  then  (u,x,-X)  is  another  solution  of  (5.2),  hence  by  Proposition  3 
u(t)  »  kjVxtt))  for  all  t.  Now  assume  X.(t)  ¥  0  for  seme  t  e  [0,T].  Then  [t  ,t] 
contains  only  finitely  many  zeroes  of  X^ .  To  see  this,  set  mj  ■  (k-1-eJX^,  m2  “ 

(k+1+*  )Xj.  Whenever  X1(t)  ¥  0,  u  is  constantly  equal  to  sgn  Xj(t)  on  a  neighborhood 

of  t,  hence  X,)  is  three  times  differentiable  at  t.  By  (5.3) 

.2 

-  «,  <  -2-5-  |X  (t)|  <  -a  <  0  .  1 9.5) 

4  at4 

It  X1  vanishes  Infinitely  many  times  inside  (t,TJ,  lat  Tq  be  the  smallest  time. 

Recursively,  set  Tn+1  "  Xnftt  6  (t^.TJi  X^(t)  “  0} .  By  (9.5),  ^(Tjj)  **  0  and  To  an 

isolated  zero  of  X^.  By  induction,  one  easily  checks  that  the  same  holds  for  every  n, 

hence  the  sequence  (T  )  is  strictly  increasing.  We  now  apply  Lemma  4  to  the  function 

♦  <t)  »  I X  ( t  +t)|  for  each  interval  ft  ,t  The  second  estimate  in  (9.1)  is  obtained 

'in  n  n+ 1 

from  (9.4)  and  (6.1),  setting  0  -  mo'.  Using  (9.2)  we  deduce 

l^1(Tn+1>  I  >  -  4<Ki«1+2m2)m^3  I ^ , ( Tn )  |  • 

If  infinitely  many  t  were  defined,  by  Lemma  5  S*  n|X  (T  )|  -  +*.  Prom  (9.5)  it  follows 
n  n-u  1  n 

T  -  t  >  2 1 X . (t  llm”1,  hence  lim  r  -  ■**•,  providing  a  contradiction.  An  analogous 
n+1  n  1  n  2  n 

!**• 

argument  shows  that  X^  can  have  only  finitely  many  zeroes  inside  [0,t].  Hence  the 
corresponding  control  u  is  bang-bang  with  finitely  many  switchings. 


I 


10.  Proof  of  Proposition  5 


M  restrict  the  analysis  to  ths  cass  where  u(t)  -  +1  on  the  initial  interval 
[0 ,t^ > •  When  u(t)  -  -1  on  [0,^)  an  entirely  analogous  argument  applies. 


t  esan  7.  For  every  h  in  a  suitably  vail  neighborhood  V  e  F,  there  exists  a  unique 
one-parasMter  family  of  ban^bang  controls  u(5 >  «  u+(a(5),b(5),c(5)>,  (  e  [0,1/2],  having 
a  first  switch  at  time  t  -  5  and  a  third  switch  at  t  -  1,  which  satisfy  Pontryagin's 
equations  (5.2)  on  the  time  interval  [5,1]  with  1^(5)  ■  X^d)  “  0. 

Proof.  Whenever  h  e  V  is  small  enough,  the  proofs  of  Propositions  1  to  3  show  that  the 
adjoint  variable  Ad)  in  (5.2)  corresponding  to  a  bang-bang  control  with  at  least  two 


switchings  inside  [0,1]  must  satisfy 


l3(t>  >  0,  IX^tJ/Xjd)  -  (1  -  ku(t) )  |  <  (k-1  )/2  (10.1) 

a.e.  on  [0,1].  To  construct  the  one-parameter  family  u(5)»  for  a  fixed  h  e  C3(S J^), 

g  -  f+h  and  5  e  [0,1/2],  let  u  -  u+(5 .tj-5, 1-t2 >  be  the  control  whose  value  is 

initially  +1  and  has  switchings  at  times  5,  t2,  1.  «•  in  (5.5).  Consider  the  Cauchy 

problem  on  wP,  starting  at  time  t  -  5» 

x(t)  ■  q(x(t) )  ♦  e1u(t)  ,  l(ti  “  -X(t)Vg(x(t) )  , 

(10.2) 

x(5)  -  (exp  ^(g+a^HO)  ,  X(5>  ■  (0,v,1) 

for  some  v  e  The  above  data  determine  uniquely  a  trajectory  t  ♦  (x(t),X(t)).  From 
(10.1)  it  is  clear  that  the  control  u  -  u+< 5 .tj-5 , 1-tj)  satisfies  the  Maximum  Principle 
(5.2)  on  a  neighborhood  of  the  interval  [5,1]  iff  Xj(t2)  “  X ^ ( 1 )  “  0.  We  claim  that 
for  V  e  F  suitably  small,  the  conditions 


W  ”  X1(1>  "  0  '  5  <  t2  <  1 


(10.3) 


implicitly  define  t2,  v  uniquely  as  functions  of  h,  5,  for  all  h  e  V,  5  e  [0,1/2]. 
Indeed,  when  h  =  0,  the  equations  (10.1),  (10.3)  can  be  solved  explicitly,  first  for  v 


as  a  function  of  t2  and  5,  then  for  t2  in  terms  of  €: 


X(t2)  -  (t2-C)(-v-«>  +  (tj-5)  (1-k)/2 


(10.4) 


The  right-hand  side  of  (10.4)  vanishes  at  the  point  t2  «  (5,1)  iff 
v  «  (t2-5)(1-k)/2  -  k5.  In  this  case 


t 


*,(1)  -  <1-t2)(t2-«)(1*k)/2  +  (1-t2)2(1-k)/2  , 


(10.5) 


hence  1,(1)  -  0  Iff 


<t2-C)/(1-t2)  -  (k-1 )/(k+1 ) 


(10.6) 


The  exact  value  of  t2  ee  a  function  of  £  ie  immediately  obtained  from  (10.6).  Frocn 
(10.6)  it  aleo  follows 


(t2-C>  >  (k-1 )/4(k+1 )  ,  1+5-2t2  >  0  ,  1-t2  >  1/4 


(10.7) 


for  all  £  €  [0,1/2].  Differentiating  (10.4)  and  (10.5)  w.r.t.  v  and  t2  respectively 


and  using  (10.7)  we  obtain 


-TT2- *  ^2  <  -  4TkTTT  <  0 


(10.8) 


91,(1) 


(1+£-2t2)(k+1)/2  +  (k-1 ) ( 1— 12 )  >  (k-1 )/4  >  0  . 


(10.9) 


By  the  implicit  function  theorem,  there  exiate  a  neighborhood  V  e  F  such  that 
(10.2),  (10.3)  determine  (t2>v)  uniquely  as  C3  functions  of  (h,£)  In  V  «  [0,1/2]. 
This  proves  Leona  7,  by  setting  a(£)  «  £,  b(£>  «  t2(£)-£,  c(£)  »  1-t2(£>. 

Next,  it  will  be  shown  that  Proposition  5  holds  if  the  bang-bang  control  u  belongs 
to  the  one-parameter  family  u+ ( a ( £  ) ,  b(e),  c<£  ) )  just  defined.  To  this  purpose  we  need  a 
technical  result,  whose  proof  is  straightforward. 

Lemma  8.  Let  K  e  F  and  let  (h,£)  ♦  4(h,£)  be  a  C2  map  from  V  x  [0,1/2]  into  R 
such  that  4(h,0)  “  0  for  all  h  6  II  and  4(0, £)  >  0  for  all  £  e  (0,1/2].  Assume  that 
either  i)  O4/9£)(0,0)  >  0  or  ii)  <94/9£)(h,0>  -  0  for  all  h  61/  and 
(924/3£2)(0,0)  >  0.  Then  4(h,£)  >  0  for  all  £  e  (0,1/2]  and  all  h  in  some 
neighborhood  of  the  null  vector  field  in  C3!^). 

For  h  e  V  suitably  small,  we  now  construct  a  second  one-parameter  family  of  bang- 
bang  controls  u'(£)  ■  u  (a(£) ,B(£ > ,Y(£) ) ,  choosing  a,  6 ,  Y  such  that  a+B+Y  -  1  and 

the  equalities  in  (5.4)  hold,  i.e. 

»i(exp  Y(£)<g-«1) )(exp  B(£)(g+e,> )(exp  a(£)(g-e,) )(0) 


"  »A(exp  c(£)(g+e1) )(exp  b(£)(g-e,) )(exp  a(£ ) (g+e, ) > (0 ) 


(10.10) 


J» 


§ 


for  i  “  1,2.  When  h  s  0,  (10.6)  implies 

a(5)  -  5,  b ( C )  -  <k-1)(1-5)/2k,  c(5>  -  (k+1 > ( 1-5 )/2k  (10.11) 

and  o(5).  8(5),  1(5)  are  obtained  substituting  the  values  (10.11)  in  (5.8).  By  the 
implicit  function  theorem,  the  condition  a(5)  +  8(5)  +  1(5)  “  1  together  with  (10.10) 
defines  a  C3  map  (h,5)  +  (a,8,l)  on  V  x  [0,1/2],  for  a  suitably  snail  neighborhood 

V  e  F.  Notice  that  when  h  =  0  and  5  ranges  inside  [0,1/2],  a(5)  and  8(5)  are 
strictly  positive,  while  1(5)  >  0  for  5  >  0.  Moreover,  (di/d5)  “  (k-1)/(k+l)  >  0  at 
5-0.  Setting  ♦  ■  1  in  Lemma  8,  we  deduce  1(5)  >  0  for  all  <h,5)  e  V  x  [0,1/2]  with 

V  small  enough.  Therefore  the  bang-bang  control  u(5)  “  u  (a(5  ) ,8  (5  )  ,1  (5  ) )  is  well 
defined.  To  prove  the  last  inequality  in  (5.4),  set  ${h,5)  ”  x3(u'(5),1)  -  Xj(u(5),1)* 

For  any  fixed  h,  when  5  “  0  (10.10)  has  the  obvious  solution  a(0)  •  b(0),  8(0)  ■■  c( 0), 

1(0)  «  a(0)  •  0.  Call  u  the  control  u+ (a(0 ) ,b( 0) ,c( 0 ) ) ,  which  coincides  with 
u~(a(0),  8(0),  1(0))  for  all  t  e  [0,1],  and  let  t  ♦  (x(t),X(t))  be  the  corresponding 
trajectory  and  adjoint  variable  in  (10.2).  Since  X^  vanishes  at  times  0,  tj  “  b(0),  1, 
as  5  ♦  0  we  have 


<X(1 ) ,  x(u+(a(5),b(5),o(5)),1)  -  5(1)>  5_1 

-  [Jg  X1(t)[u+(a(5).b(5),c(5))(t)  -  u+(a(0) ,b(0) ,c(0) ) (t)]dt 
+  0(52)15-1  -  o(5)  . 


The  same  holds  for  u  (a(5 ) ,8(5) ,1 (5 ) ) ,  therefore 


lim  <K(1),x(u"(5),1)  -  x(u‘f(5),1)>51  -  S  (1)(34/35)(h,0)  -  0  . 

5-0 

From  (10.12)  we  deduce  (34/35)(h,0)  «  0.  When  h  =  0,  (5.10)  and  (10.11)  imply 


4(0,5) 


(k-1)2(k+1)(1-5)2 
2k[2k5+(k+1)(1-5)l  * 


(10.12) 


hence  (32*/352 ) (0 ,0 )  -  (k-1)2A  >  0.  By  Lemma  8,  x3(u'(5),1>  -  x3(u(5),1)  >  0  for  all 

5  e  (0,1/2]  and  h  in  a  neighborhood  of  the  null  vector  field. 


To  conclude  the  proof  of  Proposition  5,  notice  that  for  every  constant  e'  >  0,  in 
(5.3)  we  can  choose  €  >  0  so  small  that  the  conditions 
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(10.13) 


|  X, <t )/X3  -  ( 1-k)  I  <  e  for  t  e  (O.t,)  u  (t2 , 1 )  , 


|Xl(t)/X3  -  (i+k)|  <  e  for  t  e  (t,,t2) 
together  with  X^t,)  -  X^tj)  -  X^l)  -  0,  X.,(t)  >  0  on  (0,^)  imply 

I (t2-t,)/(1-t2)  -  (k-1 )/(k+1 ) |  <  C  ,  t,  <  (1-t2)  +  e ■  .  (10.13) 

For  e'  >  0  suitably  small,  (10.13)  implies  t,  e  [0,1/2).  Therefore,  if  h  6  K  is  small 
enough,  a  bang-bang  control  u,  which  is  Initially  positive  and  has  switchings  at  times 
0  <  t^  <  tj  <  tj  *  1,  can  satisfy  Pontryagin's  equations  (5.2)  only  if  t1  <  1/2.  But  in 
this  case  u  is  the  member  of  the  one-parameter  family  of  control  functions 
u+(a(C),b(C),c(C))  obtained  by  setting  5  -  t-|.  Hence  Proposition  5  holds  for  u. 
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Appendix 


The  equalities  (5.10)  are  obtained  from  (5.6)  to  (5.9),  using  the  relations 
a6  “  be,  as  follows. 

3(Xj-Xj)  -  (a+b+c)3  -  <b+c)3  +  c3  -  (S+l)3  +  If3 

+  kta3  +  (b-a)3  -  a3  -  (B-a)3  +  (a-b+c)3) 

-  a3  +  3a2(b+c)  +  3a(b+c)2  +  (b+e)3  -  (b+c)3  +  c3  -  B3  -  SB2! 

-  3BY2  -  Y3  +  y3  +  k[a3  +  (b-a)3  -  a3  -  83  +  362a  -  36a2 

+  a3  +  c3  -  3c2(b-a)  +  3c(b-a)2  -  (b-a)3) 

-  a3  +  Sa^  +  3a 2c  +  3ab2  +  6abc  +  3ac2  +  c3  -  (a3  +  3a 2e 
+  3ac2  +  c3)  -  3a2b2/(a+e)  -  3(a*b  +  abc)  +  kta3  -  (a3 
+  3a2c  +  3ac2  +  c3)  +  3(abc  +  bo*)  -  3b2c2/(a+c) 

+  c3  -  3 be2  +  3ac2  +  3b2c  -  6abc  +  3a 2c 

-  3ab2  +  3abc  -  3a2b2/(a+c)  +  k[-3abc  -  3b2c2/(a+c)  +  3b2c)  . 

x*  -  x~  -  (aV  +  ab2c  +  a2bc  +  abc2  -  a2b2)/(a+c) 

-  k(a2bc  +  abc2  +  b2c2  -  ab2c  -  b2c2)/(a+c) 

-  |||  [a+b+c  -  k(a-b+c)J  -  (a+B+Y+k(a-B+Y )]  . 


«b 
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